Soil Moisture Active Passive Mission L4_SM Data Product Assessment (Version 2 Validated Release)

During the post-launch SMAP calibration and validation (Cal/Val) phase there are two objectives for each science data product team: 1) calibrate, verify, and improve the performance of the science algorithm, and 2) validate the accuracy of the science data product as specified in the science requirements and according to the Cal/Val schedule. This report provides an assessment of the SMAP Level 4 Surface and Root Zone Soil Moisture Passive (L4_SM) product specifically for the product's public Version 2 validated release scheduled for 29 April 2016. The assessment of the Version 2 L4_SM data product includes comparisons of SMAP L4_SM soil moisture estimates with in situ soil moisture observations from core validation sites and sparse networks. The assessment further includes a global evaluation of the internal diagnostics from the ensemble-based data assimilation system that is used to generate the L4_SM product. This evaluation focuses on the statistics of the observation-minus-forecast (O-F) residuals and the analysis increments. Together, the core validation site comparisons and the statistics of the assimilation diagnostics are considered primary validation methodologies for the L4_SM product. Comparisons against in situ measurements from regional-scale sparse networks are considered a secondary validation methodology because such in situ measurements are subject to up-scaling errors from the point-scale to the grid cell scale of the data product. Based on the limited set of core validation sites, the wide geographic range of the sparse network sites, and the global assessment of the assimilation diagnostics, the assessment presented here meets the criteria established by the Committee on Earth Observing Satellites for Stage 2 validation and supports the validated release of the data. An analysis of the time average surface and root zone soil moisture shows that the global pattern of arid and humid regions are captured by the L4_SM estimates. Results from the core validation site comparisons indicate that "Version 2" of the L4_SM data product meets the self-imposed L4_SM accuracy requirement, which is formulated in terms of the ubRMSE: the RMSE (Root Mean Square Error) after removal of the long-term mean difference. The overall ubRMSE of the 3-hourly L4_SM surface soil moisture at the 9 km scale is 0.035 cubic meters per cubic meter requirement. The corresponding ubRMSE for L4_SM root zone soil moisture is 0.024 cubic meters per cubic meter requirement. Both of these metrics are comfortably below the 0.04 cubic meters per cubic meter requirement. The L4_SM estimates are an improvement over estimates from a model-only SMAP Nature Run version 4 (NRv4), which demonstrates the beneficial impact of the SMAP brightness temperature data. L4_SM surface soil moisture estimates are consistently more skillful than NRv4 estimates, although not by a statistically significant margin. The lack of statistical significance is not surprising given the limited data record available to date. Root zone soil moisture estimates from L4_SM and NRv4 have similar skill. Results from comparisons of the L4_SM product to in situ measurements from nearly 400 sparse network sites corroborate the core validation site results. The instantaneous soil moisture and soil temperature analysis increments are within a reasonable range and result in spatially smooth soil moisture analyses. The O-F residuals exhibit only small biases on the order of 1-3 degrees Kelvin between the (re-scaled) SMAP brightness temperature observations and the L4_SM model forecast, which indicates that the assimilation system is largely unbiased. The spatially averaged time series standard deviation of the O-F residuals is 5.9 degrees Kelvin, which reduces to 4.0 degrees Kelvin for the observation-minus-analysis (O-A) residuals, reflecting the impact of the SMAP observations on the L4_SM system. Averaged globally, the time series standard deviation of the normalized O-F residuals is close to unity, which would suggest that the magnitude of the modeled errors approximately reflects that of the actual errors. The assessment report also notes several limitations of the "Version 2" L4_SM data product and science algorithm calibration that will be addressed in future releases. Regionally, the time series standard deviation of the normalized O-F residuals deviates considerably from unity, which indicates that the L4_SM assimilation algorithm either over- or under-estimates the actual errors that are present in the system. Planned improvements include revised land model parameters, revised error parameters for the land model and the assimilated SMAP observations, and revised surface meteorological forcing data for the operational period and underlying climatological data. Moreover, a refined analysis of the impact of SMAP observations will be facilitated by the construction of additional variants of the model-only reference data. Nevertheless, the Version 2 validated release of the L4_SM product is sufficiently mature and of adequate quality for distribution to and use by the larger science and application communities

Global Assessment of the SMAP Level-4 Surface and Root-Zone Soil Moisture Product Using Assimilation Diagnostics

The Soil Moisture Active Passive (SMAP) mission Level-4 Soil Moisture (L4_SM) product provides 3-hourly, 9-km resolution, global estimates of surface (0-5 cm) and root-zone (0-100 cm) soil moisture and related land surface variables from 31 March 2015 to present with ~2.5-day latency. The ensemble-based L4_SM algorithm assimilates SMAP brightness temperature (Tb) observations into the Catchment land surface model. This study describes the spatially distributed L4_SM analysis and assesses the observation-minus-forecast (O-F) Tb residuals and the soil moisture and temperature analysis increments. Owing to the climatological rescaling of the Tb observations prior to assimilation, the analysis is essentially unbiased, with global mean values of ~0.37 K for the O-F Tb residuals and practically zero for the soil moisture and temperature increments. There are, however, modest regional (absolute) biases in the O-F residuals (under ~3 K), the soil moisture increments (under ~0.01 cu.m/cu.m), and the surface soil temperature increments (under ~1 K). Typical instantaneous values are ~6 K for O-F residuals, ~0.01 (~0.003) cu.m/cu.m for surface (root-zone) soil moisture increments, and ~0.6 K for surface soil temperature increments. The O-F diagnostics indicate that the actual errors in the system are overestimated in deserts and densely vegetated regions and underestimated in agricultural regions and transition zones between dry and wet climates. The O-F auto-correlations suggest that the SMAP observations are used efficiently in western North America, the Sahel, and Australia, but not in many forested regions and the high northern latitudes. A case study in Australia demonstrates that assimilating SMAP observations successfully corrects short-term errors in the L4_SM rainfall forcing

Representativeness of CO and O3 Along ATom Transects Derived from GEOS-5 and GMI-CTM Simulations

One major goal for the NASA Atmospheric Tomography Mission (ATom) is producing an observation-based chemical climatology to represent the atmospheric heterogeneity. In this study, we use CO and O3 observations and global atmospheric model simulations to examine the spatial representativeness of the ATom-1 and -2 transects within a 4D framework provided by the NASA GEOS-5 and GMI-CTM models. Based on the probability density functions, we find that the variability of CO and O3 along the flight tracks is well hindcast by the model when sampled per ATom flights. The CO variations along the ATom-transect are likely representative of the typical CO variations over the whole Pacific basin during both the ATom-1 and -2 periods, the northern Atlantic during the ATom-1 period, and the tropical Atlantic in the ATom-2 period. Over southern Atlantic, CO along the ATom-1 transects is likely less well mixed than that of the broader region, but is still representative of the median CO concentration. CO along the ATom-2 transect is likely higher than the median CO concentration over this region. For O3, the agreements between PDFs of O3 sampled along the ATom transects and over the broader regions are fair to good over all six regions (Scores > 0.65) with notable discrepancies over some regions. For example, in ATom-1 over the northern Pacific and Atlantic, the transect samples air masses with higher O3 levels. During ATom-2, the transect over-represents the occurrence of O3 plumes over tropical Pacific. Over the southern Pacific and Atlantic for both ATom-1 and -2, the transects have a less uniform distribution compared to the surrounding basins, but still represent the median O3 abundance. Overall, we conclude in most cases that ATom measurements represent the statistical variations of these two species over the ocean basins at the time of measurement. Higher-order statistics, including covariance of species, has not been tested in this study

Office Note Series on Global Modeling and Data Assimilation

One of the main goals of the DAO is to develop a system with careful attention to needs of users, in particular the EOS instrument teams and the Earth Science applications community at large. This demand requires a comprehensive quality assurance effort encompassing the input observing system and the output global gridded fields, on time scales ranging from hours to decades. The purpose of this document is to establish the requirements for an on-line monitoring system capable of providing real-time information about the performance of several DAO systems. We describe several of the DAO's modes of operation, including its planned 1998 real-time and near real-time systems. The main components of DAO's On-Line Monitoring System (DOLMS) are discussed, including observing system and climate diagnostic monitoring. Section 3 provides an overview of the requirements for a Web-based on-line monitoring system which is described in greater detail in the Appendix. An on-line version of this docume..

Forecasting Carbon Monoxide on a Global Scale for the ATom-1 Aircraft Mission: Insights from Airborne and Satellite Observations and Modeling

The first phase of the Atmospheric Tomography Mission (ATom-1) took place in July-August 2016 and included flights above the remote Pacific and Atlantic oceans. Sampling of atmospheric constituents during these flights is designed to provide new insights into the chemical reactivity and processes of the remote atmosphere and how these processes are affected by anthropogenic emissions. Model simulations provide a valuable tool for interpreting these measurements and understanding the origin of the observed trace gases and aerosols, so it is important to quantify model performance. Goddard Earth Observing System Model version 5 (GEOS-5) forecasts and analyses show considerable skill in predicting and simulating the CO distribution and the timing of CO enhancements observed during the ATom-1 aircraft mission. We use GEOS-5's tagged tracers for CO to assess the contribution of different emission sources to the regions sampled by ATom-1 to elucidate the dominant anthropogenic influences on different parts of the remote atmosphere. We find a dominant contribution from non-biomass-burning sources along the ATom transects except over the tropical Atlantic, where African biomass burning makes a large contribution to the CO concentration. One of the goals of ATom is to provide a chemical climatology over the oceans, so it is important to consider whether August 2016 was representative of typical boreal summer conditions. Using satellite observations of 700hPa and column CO from the Measurement of Pollution in the Troposphere (MOPITT) instrument, 215hPaCO from the Microwave Limb Sounder (MLS), and aerosol optical thickness from the Moderate Resolution Imaging Spectroradiometer (MODIS), we find that CO concentrations and aerosol optical thickness in August 2016 were within the observed range of the satellite observations but below the decadal median for many of the regions sampled. This suggests that the ATom-1 measurements may represent relatively clean but not exceptional conditions for lower-tropospheric CO

Global assessment of the SMAP level-4 surface and root-zone soil moisture product using assimilation diagnostics

The Soil Moisture Active Passive (SMAP) mission Level-4 Soil Moisture (L4_SM) product provides 3-hourly, 9-km resolution, global estimates of surface (0-5 cm) and root-zone (0-100 cm) soil moisture and related land surface variables from 31 March 2015 to present with similar to 2.5-day latency. The ensemble-based L4_SM algorithm assimilates SMAP brightness temperature (Tb) observations into the Catchment land surface model. This study describes the spatially distributed L4_SM analysis and assesses the observation-minus-forecast (O - F) Tb residuals and the soil moisture and temperature analysis increments. Owing to the climatological rescaling of the Tb observations prior to assimilation, the analysis is essentially unbiased, with global mean values of similar to 0.37 K for the O - F Tb residuals and practically zero for the soil moisture and temperature increments. There are, however, modest regional (absolute) biases in the O - F residuals (under similar to 3 K), the soil moisture increments (under similar to 0.01 m(3) m(-3)), and the surface soil temperature increments (under similar to 1 K). Typical instantaneous values are similar to 6 K for O - F residuals, similar to 0.01 (similar to 0.003) m(3) m(-3) for surface (root zone) soil moisture increments, and similar to 0.6 K for surface soil temperature increments. The O - F diagnostics indicate that the actual errors in the system are overestimated in deserts and densely vegetated regions and underestimated in agricultural regions and transition zones between dry and wet climates. The O - F autocorrelations suggest that the SMAP observations are used efficiently in western North America, the Sahel, and Australia, but not in many forested regions and the high northern latitudes. A case study in Australia demonstrates that assimilating SMAP observations successfully corrects short-term errors in the L4_SM rainfall forcing

Assessment of the SMAP Level-4 surface and root-zone soil moisture product using in situ measurements

The Soil Moisture Active Passive (SMAP) mission Level-4 Surface and Root-Zone Soil Moisture (L4_SM) data product is generated by assimilating SMAP L-band brightness temperature observations into the NASA Catchment land surface model. The L4_SM product is available from 31 March 2015 to present (within 3 days from real-time) and provides 3-hourly, global, 9-km resolution estimates of surface (0-5 cm) and root-zone (0-100 cm) soil moisture and land surface conditions. This study presents an overview of the L4_SM algorithm, validation approach and product assessment versus in situ measurements. Core validation sites provide spatially averaged surface (root-zone) soil moisture measurements for 43 (17) reference pixels at 9-km and 36-km grid-cell scales located in 17 (7) distinct watersheds. Sparse networks provide point-scale measurements of surface (root-zone) soil moisture at 401 (297) locations. Core validation site results indicate that the L4_SM product meets its soil moisture accuracy requirement, specified as an unbiased RMSE (ubRMSE, or standard deviation of the error) of 0.04 cu m/cu m or better. The ubRMSE for L4_SM surface (root-zone) soil moisture is 0.038 cu m/cu m (0.028 cu m/cu m) at the 9-km scale and 0.034 cu m/cu m (0.024 cu m/cu m) at the 36-km scale. The L4_SM estimates improve (significantly at the 5 level for surface soil moisture) over model-only estimates, which have a 9-km surface (root-zone) ubRMSE of 0.043 cu m/cu m (0.031 cu m/cu m) and do not benefit from the assimilation of SMAP brightness temperature observations. Time series correlations exhibit similar relative performance. The sparse network results corroborate these findings over a greater variety of climate and land cover conditions